Skip to content

Conversation

@gmao-jstassi
Copy link
Contributor

@gmao-jstassi gmao-jstassi commented Jul 28, 2025

  • monthly.yyyymm.pl.tmpl
    • added -prefetch flag to prefetch inputs as a separate job
    • modified to tar automatically with -means flag, unless -notar flag is given
    • tightened the logic for setting dependFLG for job submittal
    • remove work directory after last means job, if there are no tarandclean jobs
    • changes necessary for tarandclean jobs to do fetch if necessary
    • added sub dump_JOBID to help debugging job dependencies
  • monthly_means.j.tmpl
    • added tarFLG to write, during fetch, files needed for tarring
    • added lastFLG to tell means job to clean workdir if no tarandclean job follows
  • monthly_means.pl
    • added links flag when calling rget to link inputs if available locally
    • moved final file check to more central location
  • monthly_prefetch.j.tmpl
    • removed links flag for separate prefetch jobs; these inputs will be copied, not linked
  • monthly_tarandclean.j.tmpl
    • added code to fetch inputs if not already fetched by fetch or means job
    • added ‘h’ flag to tar commands to work with linked files
  • testsuites/runjob.pl
    • change “Check for previous use of expid” default from “y” to “n”

Closes #382

Contigent on PR #3 in GMAO_perllib repo. GMAO_perllib v1.2.0 released.

* monthly.yyyymm.pl.tmpl
  - added -prefetch flag to prefetch inputs as a separate job
  - modified to tar automatically with -means flag, unless -notar flag is given
  - tightened the logic for setting dependFLG for job submittal
  - remove work directory after last means job, if there are no tarandclean jobs
  - changes necessary for tarandclean jobs to do fetch if necessary
  - added sub dump_JOBID to help debugging job dependencies
* monthly_means.j.tmpl
  - added tarFLG to write, during fetch, files needed for tarring
  - added lastFLG to tell means job to clean workdir if no tarandclean job follows
* monthly_means.pl
  - added links flag when calling rget to link inputs if available locally
  - moved final file check to more central location
* monthly_prefetch.j.tmpl
  - removed links flag for separate prefetch jobs; these inputs will be copied, not linked
* monthly_tarandclean.j.tmpl
  - added code to fetch inputs if not already fetched by fetch or means job
  - added ‘h’ flag to tar commands to work with linked files
* testsuites/runjob.pl
  - change “Check for previous use of expid” default from “y” to “n”
@gmao-jstassi gmao-jstassi requested a review from rtodling July 28, 2025 16:06
@gmao-jstassi gmao-jstassi requested a review from a team as a code owner July 28, 2025 16:06
@gmao-jstassi gmao-jstassi added enhancement New feature or request Contingent - DNA Do Not Approve (DNA). These changes are contingent on other PRs labels Jul 28, 2025
@mathomp4 mathomp4 added the 0 diff The changes in this pull request have verified to be zero-diff with the target branch. label Jul 28, 2025
@mathomp4 mathomp4 removed the Contingent - DNA Do Not Approve (DNA). These changes are contingent on other PRs label Aug 19, 2025
@mathomp4
Copy link
Member

@rtodling Now that @gmao-jstassi has updated the components.yaml for an updated GMAO_perllib this is a self-contained PR. You can test as desired

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

0 diff The changes in this pull request have verified to be zero-diff with the target branch. enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Month Means: No need to fetch

3 participants